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Thyroid ultrasonography and thermography are a widely used clinical 
technique for nodule diagnosis in thyroid regions. However, it remains 
difficult to detect and recognize the nodules due to low contrast, high noise, 
and diverse appearance of nodules. To alleviate doctors’ tremendous labor in 
the diagnosis procedure, we advocate a machine learning approach to the 
detection and recognition tasks in this paper. Moreover, this research mainly 
focuses on segmenting the image and finding the probable region. In this 
research work an improvised convolutional auto encoder (ICAE) is 
introduced for segmenting the image and finding the probable region of 
thyroid gland and it enhances image. ICAE comprises various layer and 
mechanism, each having their own task. Apart from the traditional approach, 
skip connection is applied for the image enhancement and dual frame is 
introduced for better feature extraction. Further optimization technique is 
used for increasing the learning rate. ICAE is evaluated considering digital 
database thyroid image (DDTI) dataset with performance metrics like 


accuracy, true positive rate, false positive rate, dice coefficient and similarity 
index (SI); also, comparative analysis is carried out with various existing 
model and proposed model simply outperforms the existing model. 
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1. INTRODUCTION 

In last decade, thyroid cancer growth has been unanimous and further growth rate is 4.5% i.e., 
higher than any other cancer [1]; moreover, in the year 2019, nearly 54,000 new thyroid cancer has been 
reported in the USA alone and nearly 2060 people passed away due to this. Furthermore, it is observed that 
chances of turning benign to malignant with a rate of 4.5%-6% [2]; hence several health task force 
recommends the screening of thyroid cancer which includes ultrasound and neck palpation in asymptomatic 
people [1]. However, screening process faces huge issues, this causes thyroid nodules to opt for a various 
method such as computed tomography, ultrasonography and magnetic resonance imaging (MRI); 
ultrasonography is one of the popular diagnostic tools as it is easily available and inexpensive. 
Ultrasonography not only differentiate among solid nodules consisting of cystic components, but it also deals 
with nodule pathology. Moreover, ultrasonography increases more indication of increased malignancy risk 
which includes microcalcification, extrathyroidal margins, wide nodules and hypoechoic solid nodules and 
further, it ignores round shape, cystic composition, smooth margins, spongiform appearance, and 
echogenicity that are associated with benign disease [3], [4]. 


Journal homepage: http://ijeecs.iaescore.com 


Indonesian J Elec Eng & Comp Sci ISSN: 2502-4752 o 343 


In general, thyroid segmentation is carried into two directions [5], [6] i.e., thyroid nodule and 
thyroid gland segmentation [7], [8]; although both are almost same, further can be categorized in four 
distinctive part [9]-[13] i.e., shape and contour-based, region-based, hybrid approach, machine learning (ML) 
approach; these four methods are described as: i) Shape and contour-based approach: In this type of 
approach, shape or boundary is used as the gland or nodule information for segmentation of nodule or gland 
in ultrasound (US) image; in this case boundaries between nodule and tissue can be blurred due to image 
artefacts and image contrast. Further, thyroid nodules are considered to be irregular. Hence these mechanism 
requires prior information of contour and shape for improvisation inaccuracy. ii) Region-based method: In 
this approach, statistical properties between the regions are utilized, these include variance and mean to 
achieve minimum energy function; further this approach assumes that same tissue are considered to 
homogeneous and various regions are considered too inhomogeneous. However, in reality, it is ambiguous, 
thus this approach requires prior shape and spatial location information. iii) Deep learning (DL) and ML 
mechanism: In this approach construct classifier is used for classifying the image blocks or pixels in US 
image; these classifiers are mainly based on machine learning algorithm [12], [13] which includes 
convolutional neural network (CNN), decision tree (DT), radial basis-function neural network (RBFNN), 
feedforward neural network (FNN), support vector machine (SVM), extreme learning machine (ELM) and so 
on. However, it faces the problem of training which is time-consuming and requires huge training tags and 
data. iv) Hybrid approach: This approach integrates any of the two methods for improvising the 
segmentation; considering the segmentation, this is undoubtedly best method; however it gets more complex 
due to two different approach [14]-[19]. 

Motivation and contribution of research work. Thyroid nodules have various forms including 
predominantly cystic, predominantly solid, cystic, and solid; moreover, segmentation of cystic components 
inside given thyroid nodule identifies the nodule composition. Moreover, the cystic component might appear 
as the hypoechoic region in the ultrasound image and hypoechoic region might be the cystic therefore it 
should not be considered as veins or arteries outside the gland as both have a similar structure. Hence 
segmentation mechanism needs to design in such a way that at first thyroid gland has to be identified then 
cystic components needs to be identified inside the nodules [20]-[23]. Moreover, deep learning has various 
application in the medical field as it is fully automatic with interface time of milliseconds and do not require 
any kind of seed, this characteristic of deep learning domain makes the model for real-time adoption. In deep 
learning, CNN has been very popular for image processing; hence in this research work, we adopt the deep 
learning domain and adopt the convolution auto-encoder for segmentation and improvise it. A convolutional 
auto-encoder is a neural network architecture that can be customized following application; further 
contribution of the research work has been highlighted through below points: 

At first, we perform extensive research of existing segmentation approach [24]-[29], study their 
methodologies and analyze their shortcoming. Further, we design and develop improvised convolution auto 
encoder aka (ICAE) for thyroid gland segmentation; ICAE not only helps in segmenting and finding return 
on investment (ROI) but also enhances the image. ICAE comprises various parts or layers; each layer has its 
significance. ICAE considers the denoising image through skip connections in the model and dual frame is 
introduced for better feature learning. Further global and local feature are learned and integrated to enhance 
the segmentation through edges; at last batch, normalization is introduced for increasing the higher learning 
rate. ICAE is evaluated considering various metrics with different existing methodology. 


2. LITERATURE SURVEY 

In this section of research work, the various existing model of segmentation is discussed, and their 
shortcomings are highlighted; although there exist plenty of methods, we focus on related existing 
mechanism. In the paper, Mahmood and Rusli [19] developed an integrated model of active contours without 
edges (ACWE) and geodesic/geometric contours (GC) and design a novel method for optimal segmentation. 
In here, at first energy function from inside and outside the contour are discretized through binary variable to 
mark the position in a given image, further contour length is discretized through geo-cuts approach, also 
these two methods were combined, and new energy function was introduced. Although this method 
improvises in terms of computing speed and prevents boundary leakage, it lacks quantitative performance 
and faces huge complexities. Moreover, sub-centimeter identified through ultrasound is not recommended in 
case of fine needle aspiration as it requires extra attention and cares for various parameters such as size 
estimation, volume estimation and nodule shape as this parameter have a huge role for the decision-making 
process of fine needle aspiration (FNA) biopsy. Segmentation of thyroid nodules helps in the estimation of 
the above parameter, segmentation is a major challenging task due to several reasons such as poor contrast 
among various anatomies and granular speckle; further considering the importance of segmentation, 
a significant amount of research has been carried out, this method includes radial basis FNN [5], active 
contour-based segmentation [6], optimized active contour [7], localized active contour [8], local region active 
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contour [9], geodesic level set [10], bilateral filtering [10] and hybrid model [11], extreme-ML [12] and 
random forest (RF) CNN model [11], [13] and few other research focused on manual segmentation. 
Moreover, it was observed that most existing mechanism of segmentation approach focuses on drawing 
manual boundary known as a seed which restricts the usage in a real-time scenario. 

Apart from the above approach, last decade has seen a rise of deep learning concept in 
segmentation; moreover, it is observed that deep neural network (DNN) performs extremely well in object 
recognition, semantic segmentation and detection [30]-[33]. Hence [20] applied the CNN for segmenting the 
thyroid nodules in 2D images of thyroid; here proposed CNN comprises two max-pooling layers and 15 
convolutional layers. Further, tenfold cross-validation is used for quantitative evaluation, out of these 10 
folds eight were training and one for validation and residual one was for testing. Similarly, cascaded CNN 
was designed in [21] in consideration of the same architecture presented in [20]; CCNN mechanism 
comprises three distinctive phases for segmentation of thyroid nodule. At first, U-net architecture was used 
for ROI extraction which consists of a thyroid nodule, later artificial masks were designed through the 
manual process of boundary adjustment and sign recognition [22] considering the ultrasonic examinations for 
patients. Moreover, artificial masks were mainly focused on the right, left, the lower and upper part of 
thyroid nodule; however, due to manual process model efficiency puts a huge question of deployment in real- 
time [34]. Further, the above methods also fail to obtain the trade-off among complexity and various 
performance metrics. 


3. PROPOSED METHODOLOGY 

In this section we design and develop improvised convolutional auto encoder for image 
segmentation. The proposed mechanism comprises various mechanism and layer. First we consider the 
general convolutional auto encoder. Second apply skip connection for image enhancement. Later for feature 
learning we apply dual frame. Alongside to learn the higher rate we optimize it through batch normalization 
process. The modified convolutional auto encoder with skip connection will aid in achieving very good 
thyroid nodule segmentation outcomes. 


3.1. Generalized convolutional auto encoder 

Convolutional auto encoder comprises two important operations i.e., convolution and activation; 
these two are combined with the pooling operations. Convolution layers are responsible for generating the 
various features for minimizing the computational capacity through distributing the kernel coefficients for a 
particular feature map. Moreover, apart from general ICAE comprises various convolutional kernel in each 
layer. Moreover, activation function has similar role for the introduced filters after kernels, which in terms 
imposes network non-linearity. Furthermore, fully convolutional network aka, convolution with kernel and 
bias value is mathematically represented through (1). 


aI = {af, a8, ene af} 
uI = (ul a, ss LA (1) 
PETE, RRRA ae} 


Moreover, by considering the FCN, convolution with kernel and bias value activation function can be 
designed and computed through equation, also the activation is for the ith layer. 


a9 = A9 (B(a97t); 79), 1 Sg Sj, 
af = d(u} @ B(a9-1) +27) €aI,1 <9 < ly, (2) 


In (2), &® represents the convolutional operator, D(..) represents the activation function and B 
indicates the down sampling; also T9 represents the entire parameter for the given layer. Further pooling 
helps in handling the huge range of receptive field in global features, also it helps in minimizing the 
parameter. In ICAE mechanism, we consider parametric rectifier linear unit (PReLU) for activation; since 
ReLU provides huge advantage in deep learning and provides the efficient solution than the sigmoid 
function. The main advantage of PReLU is that it helps in learning the small value while training the model 
which, this further helps in adopting the better parameters such as biases and weights. In case of feed forward 
network, single slope parameter is learned in each layer whereas with this activation function it is possible for 
each channel in each layer. Moreover, the mathematical definition of this activation function is given as (3). 
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v if v is greater than zero 
(param)v if vis less than or equal to zero 


fv) =| (3) 


Moreover if param is the learnable parameter then it is considered as the PreLu and modified 
mathematical definition can be given through (4). 


e(v) = max(v, 0) + (param)min(0, w) (4) 


In (4), the parameter is indicated throughparam and it ranges between 0 to 1. Moreover, feed forward of 
ICAE is represented as (5). 
sars we ÅJ +1 Al wee AZ G;:t! T? week g 
(G; T) = AY" ( oe ) ) (5) 


In (5), auto encoder mechanism G indicates the input which is equal to down sampling from (7). Set of 
parameters represented through (6). 


pT? THI} (6) 


Convolutional layer output is computed through below equation where S indicates the up sampling with A‘ 
indicating convolutional layer output to reconstruct the matrix. 


Gt = ÅI(S(åP-1); 8P) j+1<p<2j-1 
af = e(ub Q S(a?1) + z9) E€ å1,1 < 0 < Ly, (7) 


Decoding part of convolutional auto encoder is computed in (10) where b” indicates the set of bias 
value in given layer p. Moreover, reconstruction has the matrix of size given and convolutional kernel and 
bias is given in (8). 


p —§,,P ,P A 
u AA A (8) 


— ÍP ,P 3P 
z = rat 
Once the activation function is employed, we tend to improvise the learning rate by updating the set 
parameter in backpropagation. Moreover, learning rate is improvised through method of steepest descent 
where first order derivative is computed to find the local minimum and local maximum which further helps 
in reducing the loss function. 


argmin,E(A(G;T);M) (9) 
In the (9), M is output and E is loss function for measuring the error. 


3.2. Image enhancement 

The Figure 1 shows comparisons of generalized and proposed convolution auto-encoder. Moreover 
the general convolutional auto-encoder model as described in Figure 1(a) gives efficient result but it faces 
huge loss of information. This is overcome through introducing the skip connection in proposed model 
described in Figure 1(b) as it helps in improvising the information loss. Skip connection adds the local 
features to decoder. Furthermore indicates the proposed convolutional auto encoder with skip connection 
which is used for enhancing the image. 

The standard generalized convolution auto-encoder passes complete feature data through 
representation and retain low resolution feature information only in next stage; further, spatial information of 
smaller object is lost because of resolution loss post pooling operation. On the other side the proposed 
convolutional auto encoder, for smaller object, without any information loss in pooling operation the global 
feature is retained. The spatial feature is retained through introduction of blocking deconvolution path. 
Similarly, for larger objects, the skip connection is primarily focused to extract edge feature information. In 
proposed convolutional auto encoder, the deconvolution and activation of residual path include feature set to 
the skip connection based on object size. 
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Figure 1. Comparizon of convolutional auto-encoder, (a) generalized convolutional auto-encoder without 
skip connection and (b) proposed convolutional auto-encoder with skip connection 


Further we develop and design an improvised convolutional auto encoder aka ICAE; in here 
convolutional auto encoder is applied in recursive manner for low resolution; convolutional auto encoder 
with skip connection can be represented as in (10). 


A = pirans Fyaram(d)@ (10) 
In the (10), o represents filters and pt” indicates the pooling operator and uses pooling average where low 
pass filtering is used; the (10) indicates the framelet coefficient of convolution. Fparam indicates the hankle 
matrix which is responsible for the convolution; Since convolution auto encoder is bypass connection, it can 
be further represented as (11): 


A 
w=|5|=Ya@o) a1) 
where each parameter is formulated through given in (12). 
IM 
R = ae 
A=(d@@) (12) 


Q= nT" (4 O 9) 


3.3. Improvised feature learning 
In this section we design the improvised version of CAE by introducing the dual frame; from (12) 
dual frame can be mathematically formulated as (13): 


[IM y] (13) 


1 
Y= (I_M+ptransy ) 
hence considering the matrix inversion for average feeling dual frame CAE can be given as (14). 


oo trans 


7=[7-# H(t] (14) 


In given framelet coefficient W, reconstruction is given through the (15); the (15) represents network model 
of ICAE. 


Å = A + 0.5(Q — p'ra"s A) (15) 


Further in (15), S indicates unspooling and (Q — wT?" A) indicates residual. 
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3.4. Training of CNN 

Moreover, segmentation process is affected through edge of the region, further disadvantage of 
basic model is duplicate information for features, and it fails to estimate the global feature for high 
resolution. Input d¥*! without convolution in given layer the problem definition can be represented through 
(16). 


nit = gi 1@S(d*) (16) 


In (16), ® integrates two images i.e., before applying the operator and after applying the operator; 
represents the duplicated information. In improvised convolutional auto encoder (ICAE), network uses 
the remaining path for ignoring the duplicate for local feature map. In here remaining path is given right after 
pooling. Hence global feature map is passed through skip connections, also to assess the filter performance, 
performance rate is formulated. In the (17) feature map before the path and after the path is considered. 


qk+1 


if feature_map,(v,w) < 0.01 — 0.5, 
Ly,weobjectlabel(v,w) feature_mapz(v,w) (17) 
Lyweobjectlabel(w,z) feature_map;(v,w)’ 


Measuring rate= ; 
8 otherwise, 


Further in proposed model of convolutional auto encoder, up sampling is performed through 


introducing the deconvolution layer in the designed path and designed operation. Hence a” represents the 


after-sampling signal and a represents the signal after convolutional layer and represented through (18). 


j+1 ij+1 = j+1 
ay = AY (B(al); 63") (18) 
j+1 — ,it1¢j-1 j+1, oj+1 
aq = AG (ai —a; 36; ), 
Similarly, au indicates the deconvolution with vth kernel and weights; in here parameter set is combined 


with (j + 1)th layers and af% "Indicates the rth kernel with r bias. 


alt? = (ui) @8B(ai-1) + zli) € dk (19) 
j+1 j+1 j— j+1 j+1 
aay = dxi D(a! — ak*1) +237") Eal", 


Further niii is considered as the ICAE convolutional operation in given (j +1) layer on decoder; 
mathematical formulation is represented through (20). 


nitar = a4 ® S(a/) 20) 
In the (20), feature information in given path is filtered through a/~+ — altt . At last, we consider the global 


feature and local feature for absolute segmentation; feature for global information is represented through (21) 
and (22). 


niie = S (A! (BC -)) @ 4i (a = alai ti’) (21) 
nea = S (ABa) @ Eptt(e™4 244) (22) 


3.5. Training of CNN 

Moreover, due to the complexity of ICAE, proposed model has an issue of convergence speed and 
the training is quite complex; hence batch normalization layer is deployed for increasing the learning rate. In 
general batch normalization computes the standard and mean deviation for the previous layer, later it 
subtracts the mean and further divides through SD. This in terms makes ICAE converge faster, and it 
becomes marginally less sensitive to the input distribution and becomes further robust to distribution change 
for the longer term. Let’s consider a layer with c — dimensional input V = (v® ste aes vy) then first we 
find the normalization of each dimension through (23). 


vO = (v® — C[v®]) (Var pOJ (23) 
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Further we consider the batch Z of size k and normalization is applied to each activation 
independently and this can be given as (24): 


Z = (M%...13 (24) 


after normalizing the values, we consider the linear transformation, and it is given through (25). 


batchporm: Vik D Wi.. k (25) 
Moreover, the batch normalization transformation is added to the network for higher learning rate i.e., 
manipulating the activation and thus increase the higher learning rate. 


4. RESULTS AND DISCUSSIONS 
4.1. Dataset description, training, and testing time 

In any machine learning based algorithm dataset plays a major role as data require for model 
training needs to be sufficient enough to perform the model. In here we have used standard dataset from the 
open access digital database of thyroid ultrasound images from the Universidad Nacional de Colombia 
Laboratory [24]. Further this dataset is utilized for computation of proposed model. Moreover dataset 
comprises 92 images of thyroid ultrasound, out of theses 42 were from female and 50 from male from 
different age group. Moreover these images were captured through TOSHIBA linear transducer and extracted 
from ultrasound video sequence. These thyroid nodules images are stored in ultrasonography model which 
includes whole diagnostic description and annotation of thyroid lesions. Further these are carried out under 
supervision of two radiologist expert using the TI-RADS lexicon. To train the model it took 1070 seconds 
considering 32 optimization epochs. On the other side the existing segmentation model [20], [29] takes about 
103.86 hour considering 20 optimization epochs. Thus, proposed segmentation model are much faster. 
The time taken for testing is 0.85 seconds for proposed and 3.25 seconds for existing segmentation 
model [20], [29]. 


4.2. Pictorial comparison description 

Here pictorial representation of segmentation outcome achieved using different methodology is 
shown in Figure 2. The Figure 2 is composed original ultrasound image of thyroid nodule. Then, followed by 
ground truth image of thyroid nodule. Then, segmentation outcome achieved using existing method namely 
SSHOS is shown. Finally, the segmentation outcome achieved using proposed namely ICAE is given. From 
result achieved in Figure 2, it can be seen ICAE achieves better segmentation outcome in comparison with 
SSHOS method. 


Original Image Ground truth SSHOS ICAE 


existing a 


Figure 2. Segmentation outcome achieved using different methods 


4.3. Metrics computation 

Further to evaluate the model various metrics are considered and compared with existing 
methodology. The existing methodology have produced the genuine effort for segmentation of thyroid gland 
for thyroid cancer detection. These method includes self-organizing map (SOM) [25], abnormal region 
gradient magnitude (ARGM) [26], neutrosophic ]-means (NLM) [27], neutrosophic distance regularized level 
set (NDRLS) [28] and existing model seed selection based on higher order spectra (SSHOS) [29]. The 
Jaccard Coefficient and Dice similarity coefficient is metrics used validating the existing and proposed 
segmentation outcomes. 
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4.4. Jaccard coefficient 

A jaccard coefficient is used for measuring similarity and diversity among given image sets. 
Precisely, jaccard coefficient is calculated as the ratio of true positive predicted with respect to true positive, 
false positive and false negative values. Furthermore Figure 3 presents the comparison of various 
methodology with proposed model. In here SOM performs very badly with jaccard coefficient of 49.99; 
however other method like ARGM, NLM, and NDRLS achieves better jaccard coefficient of 90.45, 91.56, 
and 94.2, respectively. Further existing model i.e., SSHOS achieves better result with jaccard coefficient of 
95.99 whereas ICAE achieves TPR of 99.18. 


4.5. Dice similarity coefficient 

In segmentation, Dice similarity Coefficient is an evaluation metric which is used for gauging the 
similarity between two given image. In general Dice similarity coefficient is ratio of 2* area of overlap 
(AoO) to total number of pixels in given images. Figure 4 represents comparison with various model in terms 
of dice similarity coefficient. State of art technique like SOM achieves 60.45% which is marginally less for 
application, improvising these ARGM, NLM and NDRLS achieves 78.45%, 91.09%, and 89.98% whereas 
existing model achieves 91.06%. Moreover NLM and NLM performs very well; however in comparison, 
proposed model achieves better than any of these model with 96.87%. 


0 Jaccard Coefficient Dice Similarity Coefficient 
100 
80 
S 60 S6 
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aS x S $ - 
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Methods Methods 
Figure 3. Jaccard coefficient outcome achieved using Figure 4. Dice similarity coefficient outcome 
different methods achieved using different methods 


4.6. Accuracy and comparative analysis 

Accuracy is one of the important performance metric measures in classification process; accuracy 
presents the correctly predicted model, further it is defined as ratio of number of samples correctly predicted 
to the total number of samples. The accuracy measured through correct prediction CP with respect to total 
number of samples TS which shows the proposd model achieves the accuracy of 98.39%. Further, we analyze 
the comparison of existing and proposed method by varying the performance metrics as shown in Table 1 
and it is observed that in case of jaccard coefficient metrics, proposed mechanism achieves 49.19%, 8.73%, 
7.62%, and 4.98% better than SOM, ARGM, NLM, and NDRLS mechanism respectively; further it also 
outperforms the existing approach with achieving 3.19% more efficient than the existing model. Furthermore, 
considering dice similarity Coefficient false positive rate; proposed mechanism outperforms the existing 
models by 36.42%, 18.42%, 5.78%, and 6.89% for SOM, ARGM, NLM, and NDRLS mechanism 
respectively, also it performs 5.81% better than the existing approach. 


Table 1. Comparative analysis 


Model Jaccard Coefficient Dice Similarity Coefficient 
SOM [25] 49.99 60.45 
ARGM [26] 90.45 78.45 
NLM [27] 91.56 91.09 
NDRLS [28] 94.2 89.98 
SSHOS [29] 95.99 91.06 
ICAE-Proposed 99.18 96.87 
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5. CONCLUSION 

Segmentation is considered as one of the eminent step in detection of thyroid cancer, in this research 
work improvised version of convolutional autoencoder, also known as ICAE is developed to achieve the 
absolute segmentation. ICAE is designed to overcome the shortcoming of traditional convolutional auto 
encoder and focuses on enhancing the image, better feature learning and achieving high learning rate. 
Moreover ICAE considers the traditional convolutional auto encoder and adds the skip connection to enhance 
the image information, introduce the dual frame to better feature learning and optimizes for higher learning 
rate. Moreover while evaluating the model through comparative analysis we observe that proposed ICAE 
outperforms various model including the existing model; furthermore ICAE achieves comparatively better 
results by 3.19% and 5.81% in terms of Jaccard coefficient and dice coefficient respectively. Segmentation 
has been always a difficult task in identification of disease through image as even slight changes in 
evaluation produces marginal difference; since considering the vulnerabilities of medical image analysis our 
model performs better, however there are several research area that needs to be considered and further 
optimization can be achieved in future. Future work would further consider adding different noise such as 
Gaussian, speckle and study the impact of segmentation outcome using ICAE and other existing models. 
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